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Abstract 

A holomorphic continuation of Jacquet type integrals for parabolic 
subgroups with abelian nilradical is studied. Complete results are 
given for generic characters with compact stabilizer and arbitrary rep- 
resentations induced from admissible representations. A description 
of all of the pertinent examples is given. These results give a complete 
description of the Bessel models corresponding to compact stabilizer. 



1 Introduction. 

Classically an automorphic form on the upper half plane, "H, of weight k is a 
holomorphic function, /, satisfying a condition at infinity (described below), 
on H such that 
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with T a subgroup of SL(2, Z) of finite index. In particular, if 
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then N n T is the infinite cyclic group generated by 
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with h > (called the height of the cusp). This implies that as a function of 
z, f is periodic of period h. Thus if we set 

2iriz 



then we can write 



f = J2 akrk 



The condition at infinity alluded to above implies that = for all k < 0. 
Of particular importance are the cusp forms (a& = if k < 0). Associated 
with such a form is the Dirichlet series (in the case when the height of the 
cusp is 1) 
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These are the automorphic L-functions that have played such an important 
role in the recent advances in number theory These numbers a n have a 
beautiful representation theoretic interpretation. The function / can be lifted 
to an analytic function, 0, on SX(2,R) that satisfies 
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then 
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The holomorphy condition implies that the representation of g = Lie(SL(2, 
on the span of the right regular derivatives of <fi by the enveloping algebra of 
q defines an irreducible representation of q equivalent to the space of 5*0(2)- 
finite vectors in an irreducible unitary representation of SL(2,M), (n,H), 
which is an element of the holomorphic discrete series if k > 1. The inter- 
pretation is that if H°° is the Frechet space of C°° vectors in H then there 
is for each n a continuous functional on H°°, W n , such that W n (f) = a n and 
has the property that 
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for all x in R. The theory of Maass extends the class of automorphic forms 
to include all types of unitary representations of SX(2,R). The analogous 
functionals, W, are, following Jacquet, called Whittaker functionals corre- 
sponding to the unitary character Xn of N given by 
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If, we move from the upper half plane to the Siegel upper half plane, 
Tin, consisting of elements Z = X + %Y with X and Y symmetric n x n 
matrices over R and Y positive definite. The symplectic group G = Sp(n, R) 
consisting of real 2n x In matrices with block form 



9 = 

with A, B,C, D, n x n such that if 

J = 



A B 
C D 



/ 
-/ 



with / the n x n identity matrix, then 



gJg T = J. 



Then G acts on T-L n by 



gZ= (AZ + B){CZ + Dy l . 

In this case CL. Siegel [S] considered subgroups V of finite index in Gi = 
Spin, Z) and holomorphic functions, /, on H n such that (with g in block 
form as above) 

f(gZ) = det {CZ + D) k f{Z) 

for g G T and a growth condition at oo. (In later work the factor det (CZ + D) k 
was replaced by a(CZ+D) with a a finite dimensional irreducible representa- 
tion of GL(n, C)) As above one has the subgroup N consisting of the elements 
of the form 

" I L 



n(L) 
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with L an n x n symmetric matrix over R and r fl A" contains a subgroup of 
finite index in N% — G% n N. We will assume (as above) that T (~) N = N%. 
Thus, 

f(Z + L) = f(Z) 

for L an n x n symmetric matrix with entries in Z. We can thus expand this 
Siegel modular form in a Fourier series. 

J2a s e 2mTriSZ) 

the sum over S a symmetric nxn matrix over Z. One finds that if a,s 7^ then 
S* must be positive semi-definite. As above these coefficients have a beautiful 
representation theoretic interpretation (the one that will be expanded on in 
this paper). We can consider 

X s(n(X)) = e 2 * iTr ^ 

with S symmetric nxn matrix over R. We have GL(n, R) imbedded in G 
via 



the image subgroup in G will be denoted M and P = MN is the Siegel 
parabolic subgroup of G. M acts on A" by conjugation and hence acts on its 
unitary characters. One finds that if a character is non-degenerate (that is 
the M-orbit in the character group is open) then the character must be given 
by Xs with det S 7^ 0. The stabilizer of the character is compact only if S 
is positive or negative definite. One can show (c.f. W[5]) that the only such 
models for holomorphic (resp. antiholomorphic) representations correspond 
are those corresponding to positive definite (resp. negative definite) such S. 
Thus the only generic characters that can appear if we consider holomorphic 
or anti-holomorphic Siegel modular forms are the ones with compact stabi- 
lizer. As in the case of SL(2, R) (n = 1) in number theoretic applications 
it is necessary to study analogues of the distributions W as above on the 
space of smooth vectors of a general irreducible unitary representation for 
the characters xs with compact stabilizer. 

If G is a simple group over R then we will call a subgroup with abelian 
unipotent radical, "Bessel type" if the unipotent radical admits a unitary 
character with compact stabilizer in a Levi factor of the parabolic subgroup. 
In this paper we consider spaces of functionals, W, on admissible irreducible 
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representations that admit covariants (as above) by unitary characters with 
compact stabilizer (the Bessel functionals). These are the Bessel models in 
our title). Our main result yields a complete determination of Bessel mod- 
ules for admissible representations induced from Bessel parabolic subgroups. 
Using this theorem we deduce (using results in section 3) an upper bounds 
on the dimensions of the spaces of Bessel functionals on irreducible smooth 
Frechet representations of moderate growth. This result is an inequality 
relating Bessel models to spaces of conical vectors. 

In the second section of the paper we give a complete list of simple groups 
having a non-minimal parabolic subgroup with abelian nil-radical and a char- 
acter with compact stabilizer in a Levi factor. As it turns out, the class 
consists of the groups whose symmetric spaces are the irreducible Hermitian 
symmetric spaces of tube type of rank greater than 1. We describe the differ- 
entials of desired characters in the next section. We feel that this discussion 
is of independent interest and except for the cases corresponing to SO(n,2) 
(tube domains over the light cone) there is one classical family corresponding 
the each skew field over R (Sp 2n (R) for R, SU(n.n) for C ,SO* (An) for the 
quaternions) and the classical simple Euclidian Jordan algebras (the Hermi- 
tain n x n matrices over the field). In addition, the exceptional case of £7 
is gotten from the exceptional Jordan algebra, that is, the 3x3 Hermitian 
matrices over the octonians. The corresponding compact stabilizers are the 
unitary groups over the corresponding fields (0(n), U (n), Sp(n) and compact 
F4). This material is certainly not new, however, the uniform interpretation 
of the unitary characters with compact stabilizer is important to our later 
developments and is beautiful in its own right, the proof that these are 
the only examples would take us afield so we have therefore decided against 
including it in this paper. 

Another novel feature of this paper is the purely algebraic material in 
section 3 of this paper. Which substantially simplifies the results of [W2] 
for the case of parabolic subgroups with abelian nilradical. In particular, in 
this case following the argument of [W2] one can also give a simple proof 
of Lynch's vanishing theorem. We do include a proof the exactness of the 
related spaces of covariants directly from the results in this section. 

We will now say a few words about the details main results in this paper. 
Let G be a real reductive group with maximal compact subgroup K. Let P = 
MAN be a parabolic subgroup with given Langlands decomposition. Let 
(a, H a ) be an admissible, finitely generated, smooth Frechet representation 
of moderate growth of M and let v be a complex valued linear functional 
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on Lie(A). Let Ip° ai/ be the smooth induced representation of G from the 
representation, a u , of P given by a u (man) = e^ loga ^a(m). Let P = MAN 
be the opposite parabolic subgroup (corresponding to the given Langlands 
decomposition). Let x be a unitary (one dimensional character) of N. We 
consider the integrals 

J N 

where dn is a choice of Haar measure on N and 

fp, a , v {namk) = e^°^5 P (a)^a(m)f(k) 

for / in the representation induced by <J\ KnM from K D M to K, I^dk a MnK > 
and 5p is the modular function of P. These integrals converge uniformly 
on compacta for Re v in a suitable translate of the positive cone. In earlier 
work the second named author and various other researchers have studied the 
analytic continuation of these integrals to all of Lie(A)* c in the case when x 
is generic (i.e. the M-orbit is open) in the case when a is finite dimensional 
and P satisfies appropriate conditions. The most general results in this 
direction can be found in [Wl] for earlier work the reader should consult the 
references therein. In this paper we embark on the problem of implementing 
this continuation in the case when H a is infinite dimensional. One allow this 
condition to handle all admissible irreducible smooth Frechet modules of 
moderate growth and also to handle applications to number theory involving 
general representations. Here the situation becomes much more complicated 
analytically. We will confine ourselves to a special case of what we call a 
Bessel model. That is, N is commutative and the stabilizer of x m M, M x , 
is compact. One can show that in this case M x is a symmetric subgroup of 
M. Also, in this case, there is an element, %, in the normalizer of A in K 
that conjugates P to P. We will thus consider a generic character, x, of N 
and rewrite the integral above as 

J p,a,uU) = \ x{n)~ l fp,oA w Mn)dn. 

J N 

We prove a holomorphic continuation for these integrals . We also prove that 
every Bessel model of Ip <} (TU factors through these integrals. If we fix a M x 
type then these results allow us to calculate the dimension of the space of such 
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models. For example, if a M x type has multiplicity 1 in a then the dimension 
of the corresponding space is 1. In section 6 we derive upper bounds on the 
dimensions of the spaces transforming by a given representation of M x . 

There are several new difficulties that arise in the more general case of 
noncompact stabilizer including the fact that there is more than one open 
double coset. These questions will be addressed in forthcoming work of the 
first named author. We should also point out that the aspect of our work 
that implies multiplicity one has overlap with work of Jiang, Sun and Zhu 
[JSZ] in the special case of SO{n, 2) 

We would like to thank Dipendra Prasad for initiating this research by 
asking whether the results as described are true for GSp 4 (R). Since its 
commutator group is the rank 2 group corresponding to R below, this paper 
answers his question in the affirmative. 

2 A class of examples. 

In this section we will describe a collection of real reductive groups for which 
the results of this paper apply. Let G be a connected simple Lie group 
with finite center and let K be a maximal compact subgroup. We assume 
that G/K is Hermitian symmetric of tube type. This can be interpreted as 
follows. There exists a group homomorphism, 0, of a finite covering, S of 
PSL{2, R) into G such that if H = <j)(S) then H n K is the center of K. We 
take a standard basis h, e, / of Lie(H) over R with the standard TDS (three 
dimensional simple) commutation relations ([e, /] = h, [h, e] = 2e, [h, f] = 
—2/). If = Lie(G) we have g = n © m © n with ii, m, n respectively the 
—2, 0, 2 eigenspace of ad(h). In particular, n and n are commutative and e G n, 
/en. Let 9 be the Cartan involution of G corresponding to the choice of K 
then we may assume, 9n = n, / = — 9e and R(e — /) = Lie(H n K). Set p = 
m © n and let P = {g G G\Ad(g)p = p}. Then P is a parabolic subgroup 
of G. Let M = {g G G\Ad(g)h = h}. Then M is a Levi factor of P and 
N = exp(n) is its unipotent radical. With this notation in place we can 
describe some remarkable properties of these spaces. 

Lemma 1 Let M f = {m G M\Ad(m)f = /}. Then M f = M n K. 

Proof. We note that as a representation of H under ad, q = aF° © bF 2 . 
Here F k is an irreducible representation of Lie(H) of dimension k + 1 (i.e. 
highest weight k). Here b = dimn and a = dimg — 3b. On the other hand 
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m is the zero weight space for the action of h. Furthermore, using standard 
representation theory of a TDS we see that if F is a TDS module and if v G F 
is such that hv = and fv — then ev — 0. this implies that a = dimM-'. 
We also note that the same argument implies that adf : n — > m is injective. 
Since Ad(m)f = f and Ad(m)h = h for m G M-f we see that 

[Ad(m)e, /] = [Ad(m)e, Ad(ra)/] = Ad(m)h = h 



so 



[/, e - Ad(m)e] = 0. 

Hence Ad(m)e = e for m G M / . This implies that M / C if = G 
G|AZ(#)(e - /) = (e - /)}. We note that M n if is the group of all m G G 
such that Ad(g)h = h and Ad(g)(e — f) — e — f (and hence Ad(^) [h, e — f] = 
[h,e-f]). Thus M n if C MK ■ 

We now give a complete listing of the examples: 

I. G — Sp(n,M) realized as 2n x 2n matrices such that gJ n g T = J n with 



Jn 




-L 







with i n the n x n identity matrix (upper T means transpose). 0(g) = (g 1 ) T . 
Thus identifying R 2n with C using J n for the complex structure, if — U (n) = 
Gf]0(2n). Here 



Thus 



i n 





M = 





In 



In 








5 o 



iV 



i X 
I 



g G GL(n,l 
X G M(n,M),X T = X 



Finally, M f = 0(n) C C/(n). 

2. G = SU(n,n) realized as the 2n x 2n complex matrices, g, such that 
= L n with 

i/ n 
-tin 
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Then K = U(2n) n G = S(U(n) x U(n)) the center of K is the set of all 



(cos 6) I n (sin 6) I r 
-(sm9)I n (cos 9) I, 



n 



n 



with 6 G R. We take the same e,f,h as in the case of Sp(n, R). The 
centralizer, M, of /i in G is the set of all 



with g G GL(n, C). is the set of elements in M with g G C/(n). 

3. G = S'0*(4n) realized as the group of all 5 G 50(471, C) such that 
9-hn9* = -hn- Here K is isomorphic with U(2n). Here X = G n 50(471, R) = 
5p(2n,R) n 50(4n,R) ^ C/(2n). We can describe g = Lie(G) as a Lie 
subalgebra of M 2n (H) as the matrices in block form 



with A,X,Y G M n (H) and X* = X, Y* = Y. In this form g n M 2n (R) = 
Lie(Sp(n, R)). We take e, /, /i as above and note that M = GL(n,W) and 
M* = Sp{n) the quaternionic unitary group. 

4. G the Hermitian symmetric real form of E 7 . In this case we will 
emphasize a decomposition of Lie(G) which makes it look exactly like those 
examples l.,2., and 3.. In each of those cases we have 



with A an element of M n (F) and F = R, C or HI the upper * is the conjugate 
(of the field) transposed. Furthermore, X,Y are elements of M n (F) that are 
self adjoint. Example 5 corresponds to the octonions, O. Here we replace 
M 3 (0) by m = R © E 6j2 (the real form of real rank 2 with maximal compact 
of type F4). We take for X, Y elements of the exceptional Euclidean Jordan 
algebra (the 3x3 conjugate adjoint matrices over O with multiplication 
A ■ B = \{AB + BA) thus in this case the X's and Y's are defined in the 
same way for the octonions as for the other fields). Here m acts by operators 
that are a sum of Jordan multiplication and a derivation of the Jordan algebra 
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-1 



A X 
Y -A* 



Lie(G) 



A 
Y 



X 

-A* 
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(the derivations defining the Lie algebra of compact F 4 ). With this notation 
our choice of e, /, h are exactly the same as the examples for R, C or EL 

There is one more example (that doesn't fit this beautiful picture). 

5. G — SO(n, 2) realized as the identity component of the group n + 2 
by n + 2 matrices that leave invariant the form 

'In 

-I 2 ' 

Here 



On-l 

















2 








2 





















where the O's on the edges are either n — 1 x 1 or 1 x n - 1. Also 





" n _! 








" 




" n _! 
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,/ = 
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e = 
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-1 
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-1 
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1 






Here 

K - \ h ° 
[ k 2 _ 

with k\ G SO(n) and k 2 = SO (2). Thus e — / is an infinitesimal generator 
of the center of K (if n > 2). M is isomorphic with 

M x x w O(n-l,l) 

and 

M f = 0{n-l). 

3 The tensoring with finite dimensional rep- 
resentations. 

Let g be a reductive Lie algebra over C. Choose an invariant symmetric, 
nondegenerate, bilinear form, (..., ...), on g. Let e, /, h e g span a TDS. We 
assume that aci/i has eigenvalues —2,0,2. Let = {x e g|[/i, x] = jx}. Set 
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m = g and n = g 2 and p = m © n. Let x( x ) — (fi x ) f° r x e n. Let M. x 
denote the full subcategory of g-modules such that the elements x — x( x ) 
act locally nilpotently for x G n. If M G M. x then we set Mo = {0} and 
Mj + i = {m G M\(x — x{ x )) m G Mj} for j > 0. Then we have 

Uj> Mj = M, Mj C M j+1 . 

We note that M x = {m G M|xm = x(x)ra, x G n}. 
We define a bilinear form g on n by 

g(u,u) = -(adfu,v) = ([f,u], [f,v]). 

since adf 2 : g 2 — > 0-2 is injective and (..., ...) defines a perfect pairing between 
02 and g_ 2 we see that q is nondegenerate and symmetric. Let x±, ...,Xd be 
an orthonormal basis of n relative to q. We set 

d 

Q = 5^L/>i](zi -x( x i))- 

i=l 

Then Q depends only on e,f,h and the choice of (...,...). We normalize 
(..., ...) so that (e, /) = I. 

Lemma 2 There exist elements Xij G n, 1 < i,j < d such that x( x ij) — 
and [xi, [f, Xj}} = b^e + x^. 

Proof. This follows directly form the definitions. Indeed, ([x i: [f,Xj]],f) = 

{[f, x j], [f, x i]) = Sij. ■ 

If v G n we will use the notation v' for v — x( v )- 

Lemma 3 If u G m then uMj C M j+1 . 

Proof. Let z±, Zj+i G n. We must show that z\ • • • z'- +1 um = if m G Mj. 
We write 

j'+i 

• • • z j+1 um = uz 1 ■ ■ ■ z j+1 m — ^ ^ • • • [u, z»] • • • z j+1 m. 

i=i 

Writing [tx, Zj] as [u, Zj\' + Zj]) and using the fact that m G Mj we 
have 

^ • • • z' j+1 um = -^2 x{[u, Zi\)z[ ■ ■ ■ ■ ■ ■ z ' j+ i m = 0- 

i 
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Which is for the same reason ■ 

We now come to the main Lemma of this section (which due to our 
assumptions in this section is a substantial simplification of the results in 
[Wl]). 

Proposition 4 Ifm € M s+1 then 

(Q - s)m E M s . 

Proof. We first note that QMj C M 3 - for all j > 0. This follows since 
[/, Xj] G m and (x { — x(xj))Mj C Mj_i. Let 1 < i 1: ...,i s < d. If m £ M s+1 
we consider 

d 

m 



11 ' r\ ' ' ' \t l / 

T* 1™ • • • If* I ) YY~) > T If* ... r f i If* ■ If* 1 



J'=l 

X h X i 2 ' ' ' X h-i \- X ki [/' ^jll^ij+i ' ' ' X i s X j m + Q X i 1 X i 2 ' ' ' X i a m - 

j=l 1=1 

The last term above is 0. We look at the sum. The lemma above implies 
that [x iv [/, Xj]\ = Si h je + x it j with x( x kj) = 0- This implies that the sum is 
equal to 

d s d s 

X v X v 11 ' r / II X v X v 11 ' I II 

/ , / , X !l I i2 ' ' ' X ii-i°hj eX ii+i ' ' ' X i s X j m +2-^ 2-^ X h X i2 ' ' ' X ii-i X Hj X i l+1 ' ' ' X i s X j m - 
3=1 1=1 3=1 1=1 

The latter sum is by the definition of M s+1 . Also since e' = e — 1 we have 
the expression 



J2 x 'h x 'i 



. rf rf ... >~f* >f* YY~) Q f* ~f* ... If* Yf~~) 

t 2 ^H-ik+i x is X ii" L ~ bx h x i2 x i s " L 



1=1 



since u is abelian. Thus x^x^ 2 • • ~x^ XQ-s)m = 0. m 

If M is a g-module we set Mi = {m e M\(x — x(x))m = 0}. We think 
of this as a functor from the category of g-modules to the category of vector 
spaces. The next result is a special case of [Wl] and is original due to [L]. 

Proposition 5 The functor M — > Mi is exact when restricted to M. x - 
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Proof. Let 

P 

O^A^B^C^O 



be an exact sequence in M. x . Then we must show that if v G C\ then there 
exists w G B 1 such that pw = v. Let z be any element of B such that pz = v. 
Then if z G -Bx we are done. Otherwise z is in _B S+1 for some s > 1. The 
previous result implies that 

s 

3=1 

Also 

s s 

p n - ft* = n - = (- i ) ss!y 

3=1 3=1 

since pz = v and Qt> = 0. Thus we may take w = 0^=i(Q — i)- 2 - B 

Let M G .M x and let F be a finite dimensional g-module. Let F J — {/ G 
F\hf — jf}. If rr G n then xF- 7 C -F J+2 . Let r be the maximal value of j 
such that F j ^ 0. Thus the minimal value is — r. Then we have 

Proposition 6 We use the notation above. Mi (g) F is contained in (M ® 
F) r+i . Furthermore, 

r 

Y[{Q -j):M l ®F^(M® F)x 
j'=i 

bijectively. 

Proof. If 2 G n and m e Mi, f e F j then 

z'(m <8> /) = z'm <S> f + m <S> zf — m<S> zf. 

This implies that 

*i ' ' ' ® /) = m (8) • • • 

and since ^ • • ■ z' r+ if G _pj+ 2r + 2 and j > — r the first assertion follows. 

To prove the second assertion we first note that if m G M 1 and / G F j 
then 

Q(m®f) = Y t \f,x i ](m®x i f). (1) 
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Thus if we set F>j = ®i>jF l . Then 

Q(m <g> F>j) c M <g> F> j+2 . 

Set T = n5=i(Q ~ i)- Let it = J2 m ji ® /ji with G Mi and /j, G F J 
forming a basis of F- 7 . Let j Q be the minimum of the j such that there exists 
an rriji 7^ 0. Suppose that Tu = 0. Then (pQ) implies that 

= (-l)V! ^m io< ® / io < + w ii ® & 

for appropriate tOjj. This is a contradiction. So T is injective. We note that 
by the first part and Lemma 3, T(M\ ® F) C (M eg) To complete the 
proof we need only prove the surjectivity. So let u G (M g) F)±. Write u as 
Sij>j m i« ® fji as above. Then (*) above implies that rrij oi G M\. Thus if 
w j = J2i m joi ® /i„i then (as above) 

(— l) r 

Hence 2: = u - ^f-Yv jo G (M ® F) 1 and 

«,i>ii 

with ji > j . We can thus prove the surjectivity by the obvious contradiction 
or by the obvious iteration to calculate a preimage. ■ 

4 Some Bruhat theory. 

Let G be a real reductive group of inner type (as in [W3]) with compact 
center and maximal compact subgroup K. Let P Q be a minimal parabolic 
subgroup of G and let P D P Q be a parabolic subgroup. We endow the 
two groups with compatible Langlands decompositions P Q = M A N and 
P = MAN. That is, M A (resp. MA) is a Levi factor of P a (resp. P), A Q 
is the identity component of a maximal split torus over K, A is the identity 
component of a maximal split torus in the center of P D 0-P (# the Cartan 
involution corresponding to K) and iV (resp. iV) is the nilradical of P a (resp. 
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P). We have N C N Q , A C A Q , M C M. Let W be the Weyl group of G with 
respect to A Q and let Wm be the Weyl group of MA with respect to A Q . Let 
$ (resp. $Af) denote the root system of G (resp. MA) relative to A . Let 
$ + denote the system of positive roots in $ that are roots of A Q on iV . Set 

$^ = $+ n $ M . 

Let W M denote the set of all w G W such that w$ M C $ + . Then it is 
clear that W = W M W M with unique decomposition. If w G W we choose 
w* G A^x(Ao) such that M D w* = w (here -/Vx(Aj) is the normalizer of A Q in 
K). The Bruhat Lemma says that 

G= |J P c ti;*P. 

Lemma 7 M^rf/i £/ie notation as above and Km = K (1 M we have 

G= |J P a w*K M N. 

w&W M 

Furthermore, let wq denote the longest element of W and wm the longest 
element oJWm then if w G W M and w ^ w M = wqWm then 

dim P a w*K M N < dim P {w G w M )*K M N. 

Proof. We note that W M = {w G W|u>$jk c $+ ) hence w*(P o nM)(w*)- 1 C 
P D . The Iwasawa decomposition implies that 

m = (P Q n m)Km- 

Since W7*A (w*)" 1 C A G for all u> G VP we see that 

G= |J p w*(p nM)K M N = [J py(p nM)( w tV^ 

wew M w£\v M 

= |J P w*K M N. 

w£W M 

The dimension assertion follows from the fact that iy = wgWm is the unique 
element of VF M such that w*N(w*)- 1 n N Q = {1}. ■ 

We now return to the notation in section [2j We choose a minimal 
parabolic subalgebra in P, P Q , and If, e, /, h as in that section. Then LieiKu) = 

. Let (..., ...) denote a positive multiple of the Killing form. Let x(exp(a;)) = 
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e *tB(f,x) w j^] 1 ( ^ o for i £ n. We fix an admissible, finitely generated, 
smooth Frechet representation of M of moderate growth, (a, V a ). Let v G 
(a = Lie(A)). We set 



is C°°, <f)(namg) = a u+p a(m)<f)(g), 
n e N, a e A, m e M, g <E G 



and Tip^^(g)(j)(x) = <p(xg). If we endow Ip° au with the usual C°° topology 
then Trp, a ,v is an admissible, finitely generated smooth Frechet representation 
of moderate growth. We set Up, a ,v = {4> £ -^v,J su PP0 c P(u> M )*iV}. Let 
^^x(^cr^) be the space of all continuous functionals T G (Ip ^)' (contin- 
uous dual) such that T(7r p>cr ^(n) _1 0) = x(n)T(0), this space is called the 
space of Bessel models for Ip° au - We will now show how to define a Km 
intertwining operator 

* P „ : Wh x (I^ v ) — > 

Let D'(P(w M )*N : K) be the space of V^-valued distributions on P(w M )*N. 
Given A G Wh x {If^ v ), we will first define a distribution A G D'(P(w M )*N : 
Vo-) in the following way: given / G C^°(P(w M )*N) and t> G extend / to 
G by in the complement of P(w M )*N, and define /„ G -fpj^ by 



fv(g) = J Ovip) 1 5p{p) *f(pg)vd r p 



for a choice of a right invariant measure d r p. Observe that f v G Up, a , v . Now 
define 

\(f)(v) = \{f v ). 

It's easy to check that X(L p f) = [6p(p)*<r v (p)*](\(f)), and \{R n f) = x(n)^ 1 A(/), 
i.e., A is actually in D'(P(w M )*N : V Gv _ p ® C x -i) PxN , the space of (K„_ p ® 
C x -i)'- valued invariant distributions under the action of P x N. Observe 
that P x N acts transitively on P(w M )*N and hence by theorem 3.11 of 
[K-V] there exists an isomorphism 

D'(P(w M )*N : V Cv _ p <g) C x -i) PxJV — > (V^_ p (8) C x -i) (PxA °(- M )* V£ 

Let /xa be the image of A under this isomorphism. Then using again theorem 
3.11 of [K-V] we have the following explicit description of A in terms of 

\(f)(v) = J J x(n)- 1 f(p(w M yn)^ x (a u (p)- 1 5p(p)-h)d r pdn 

= /*°JL „(/„) = >(£). (2) 
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Where the last equality follows from the definition of A. Set $p )(T ,i/(A) = 
Observe that, since f v G Up atV , the integral in the right hand side of equation 
([2]) is absolutely convergent, and hence Qp,o,v is well defined for all v G a'. 
The purpose of this section is to show that &p,a,v is injective, in the next 
section we will show that it is surjective. The following lemma is an important 
first step in order to show the injectivity of ^p, a ,v 

Lemma 8IfwG W M is not w M then 

(f,Ad(w*)Lie(N o ))^{0}. 

Proof. We note that the tube type assumption in section [2] also implies that 
$ is a root system of type C n with n = dim A Q . This implies that there exist 
linear functionals £i, ...,e n on a Q = Lie(A Q ) such that 

$+ = { £i ± eAl < i < j < n } U {2e 1 , 2e n } 

and 

Hi = <i<j<n}. 

We note that this implies that e^h) = 1 for all i. Ifwe W M and (/, Ad(w*)Lie(N )) = 
{0} then we must have 

-2ei G i = 1, n. 

We therefore see that Ei{w~ l h) < for all i. Hence — (e, + Sj) G w§ + for all 
i < j. This implies that w = w M . ■ 

We will now use these results and some standard Bruhat theory to prove 
some vanishing results. Observe that the next proposition immediately im- 
plies the injectivity of ^p, a ,v 

Proposition 9 If X e Wh x (Ip° u u ) and \\u P ^„ = then A = 0. 

Proof. We will first reduce the problem to the case where a is an induced 
representation. If (rj, V) is a finite dimensional representation of P Q , we 
define Ip^ v to be the space of smooth <p : G — > V such that 4>{pg) = 
r)(p)<f)(g) for p G P and g G G. Set 7i v (g)(j)(x) = <fi(xg), for x,g G G. If we 
endow Ip^ ^ with the C°° topology, then (71^, Ip° 0jV ) is an admissible, finitely 
generated smooth Frechet representation of moderate growth. Let (£, F) be 
a finite dimensional representation of Pm '■= P H M and let (7^, Ip° M ^) be 
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the corresponding representation of M (Observe that P R M is a minimal 
parabolic subgroup of M). The Casselman-Wallach theorem implies that 
there exists a surjective, continuous, M-intertwining operator 7 : Ip^ g — >■ 
V a for some finite dimensional representation (£, F) of Pm- This map lifts 
to a surjective G interwining map 7 : Ip 3 ^^ — > ^a,v gi ven by L(<p)(g) = 
L((f>(g)) for G 7p? The representation TpP^j, is equivalent to the 

representation smoothly induced from P D to G by the representation £ v of P 
with values on F defined as follows: 

£ u (nap) = a u+p £(p) for p E P M , a E A, n E N. 

Setting 7] = £„ we can identify the map 7 with a surjective G-equivariant 
map 7 : 7^ — ► 7^. Set £/ Poir; = {0 G | supp0 C P(w M )*N}, and 
define VF/i x (7pP ) in the same way as above. Assume that we have proved 
the proposition for 7£P , i.e., assume that if A G Wh x (I^ aV ) and \\u Po n — 0, 
then A = 0. Let A G W^ X (7J? CTI ,) be such that A|[/ PjCT> „ = and let A = 7* A be 
the pullback of A to Wh^Ij?.) by 7. It's easy to check, using the definition 
of 7, that X\u PoV = and hence, by our assumptions, A = 7* A = 0, but 7 is 
surjective, therefore A = 0. We will now prove the proposition for Wh x (Ij? tTI ). 

Let D'(G : F) be the space of all F'- valued distributions on G, i.e., the 
space of all continuous maps form C%°(G) to F' . Let A G Wh x (I^ a „) be such 
that X\u Po — 0. We will define a distribution A G 7)'(G : F) in the following 
way: given G C%°(G), and t> G define 0^ G 7|P by 




and set A(0)(v) = \{4> v )- It's easy to check that A(7 no 0) = [r/(n o )*]A(0) and 
A(P n 0) = xH _1 A(0), i.e., A is actually in D'(G : F ® C x ) N ° xN (x(n)* = 
X(^)" 1 ). We note that K M = M f , thus K M = {m E M\ \ ° Ad(m) = 
x}. Hence we can extend the action of N x N on F' <g> C x -i to an action 
of P x KmN. Furthermore, according to lemma d G has a finite orbit 
decomposition under the action of P x KmN . Hence if we set 77 = P Q x 
KmN, and H' = N x N we are in the setting of the vanishing theorem 3.9 of 
[KV]. To finish the proof of the proposition we just need to show that A = 0. 
Observe that, since X\u = 0, A = on the big Bruhat cell P(w M )*N. 
The proof of the vanishing of A is now completely analogous to the proof of 
theorem 4.1 in [KV] and follows from the fact that iV acts unipotently on 
U(g) <g) F' and x is non-trivial on iV D w*N (w*)~ 1 if w E W M and w ^ w M . 
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5 The main theorem 



We are now ready to combine all of the material of the previous sections. The 
e, /, h in section [3] do not agree with those in sections |2] and HI In the formulas 
in section 1 we must use e — > -^e, / — > itf and an appropriate normalization 
of B. With this in mind we denote by Q the operator corresponding to 
these choices. We retain all of the notation of the previous sections (with the 
proviso above). Let F be a finite dimensional representation of G. Let r be 
as in Proposition 6. Set 

i=l 

Then Proposition 6 says that if M £ Ai x then 

r F : Mi <g>F -»■ (M ® F)i 

is bijective. We also note that the definition of Q immediately implies 

Lemma 10 With the notation above Q £ U(qc) Km ■ 

We are now left with the proof of the surjectivity of ^p, a ,u- As in [Wl] we 
will first show that ^p,a,u is a bijection for v in an open set of a', and then 
we will use the results in section [3] to show that $ p )CT)i , is an isomorphism for 
all v £ a' 

Lemma 11 There exists a constant q a such that 

J X p«M)= I x(n)"Vp,^((«; M )*n)dri 

J N 

converges absolutely and uniformly in compacta of {v £ a^lRei/ > q a } for 
all 4> £ Ikv\M- Furthermore, if v £ a£, Re v > q a , and // £ V^, fi ^ 0, then 
[i o Jp^^ 7^ and 

$P, a>v :Wh x (I^ v )^V; 

is an isomorphism. 

Proof. The convergence result can be proved using the same arguments as 
in [Wl]. To prove the isomorphism statement observe that, since Jp al/ (4>) 
is absolutely convergent for Rez/ > q a , we can use equation (j5J) to define the 
inverse of Qp t<T<u - ■ 
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Theorem 12 With notation and assumptions as in the end of last section. 

i) The map 

*pw : wh x (i^) — ► v; 

defines a KM-equivariant isomorphism for all 

ii) For all \i G V' a the map v i— >■ \i o Jp au extends to a weakly holomorphic 

map ofa* c into (I% nM ,a\ KnM )' ■ 

This result immediately implies 

Corollary 13 Let F T be an irreducible, finite dimensional representation of 
Km, and let W h XtT (Ip' (T v ) be the space of all continuous linear maps T : 
Ip°,<T,v ~~ Ft such that 

T(<K P , a , u (kn)<f>) = X (n)- 1 r(A;)T(0) 

for k G Km, n G N . Then 

dimWh x , T (Ip,^) = dim Ham KM (V a: F T ) 

Proof (of theorem). During the course of the proof we will use the 
following notation: If (77, V v ) is a representation of P, let 

j~ = {4>:G^V i \4>{pg) = 5{p)^{p)<j>{g)} 
U P £ = {(f) G Ips I supp C P(w M )*N}. 

Observe that if G U then has compact support modulo P, as otherwise 
the support of 0, which is a closed set, could not be completely contained in 
the open cell P(w M )*N. Define 

$ P , C : Wh x (I%) — ► VI 

to be the map analogous to the map $ p iCTj „ that was defined in the last section. 

Let L be such that if Re v > L, then $p )OV is an isomorphism. Observe 
that, by lemma [TTl such an L exists. We will fix such a v. 

Let (rj, F) be a finite dimensional representation of G, and let 

Fj = {v G F\h ■ v = jv}. 
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Then F = Q) T j =0 F r _ 2 j, for some r with F r ^ (0). Note that nF r _ 2 j C F r _2(j+i) 
and hence if we set Xj = ® r k= jF r _ 2k , then 

F = I Dl 1 D"Ol f D X r+1 = (0) (3) 

is a P-invariant filtration. Let = {<p G F'|0|x.i=o}; then 

F' = Y r+1 D Y r D ■ ■ ■ D r° = (0) 

is the dual filtration to ([3]). 

We will take lp° av ® F to be the space 

{</> : G — > V av <g> F\<P(pg) = (a u (p) ® I)<l>((,)} 

and observe that 

Ip,«„ m = {<!> ■ G — > V av ® F|0(pp) = (o-„(p) ® iy(p))^)}. 

With this conventions there is an isomorphism of G-modules 

Ip,„„®F = (4) 

where 

= (I <g> V(g))<f>(g), and = (J <g> 77(^7) 1 )0(t 7 ). 

Let (r)j,Xj) be the restriction of 77 to P acting on Xj, and let (fjj,Xj/Xj +1 ) 
be the representation induced on the quotient. The P-invariant filtration 
given in induces via the isomorphism in a G-invariant filtration 

roo — too joo _ /n,\ 

1 P,u v ®r > — 1 P,cr„®r] ->■■■-> 1 P,a v ®ri r+1 ~ \ u ) 

and it's easy to check that 

roo / roo roo 

1 P,a l ,®r)jl 1 P,o v ®rij +1 1 P,a v ®fjj- 

Let T = (— l) r /r! nL=i(Q — j) as before, and define 
f : Wh x (I™J ®F'^ Wh x (I™ aum ) 
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by f (A)(0) = T (A)(0). Then f defines a i^M-equivariant isomorphism. Now 
since $p jOV is an isomorphism, we can define T such that the following dia- 
gram is commutative 



r 



Wh x {I%J®F> 



Wh x {l 



oc 



{V a ® F)' 



r 



^®F' 



(5) 



Claim 14 T is an isomorphism. 

Observe that the claim immediately implies that <&p^ v ®ri is an isomor- 
phism. We will now proceed to prove the claim. 

Let G V' a <E> F' . Since we are assuming that $p )OV is an isomorphism, 
there exists A G W/i x (F^ CT J ® F' such that /i = ($p j(7l/ ® J)(A) =: /i A , i.e., if 
G U Py(7v ® v , then 



We will show that if /x A G V^Y j , then /i A -(/®j|(a) M )*)r(^) G V^®^ -1 , 
which is enough to prove the claim. Observe that for any such fi\, A G 
Wh x (I^ av )®Yi, and hence T(A) = A + A, with A G (/^J'®^' -1 . Therefore 
if G Ip° :<Tv <g> then A(0) = and 




r(A)(0) = A(0) + A(0) = A(0). 



Now by definition 



f (A)(0) = T(A)(0) = /i A ( / X (n)-V(w) d„). 



(6) 
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But on the other hand since G Up^^ 

f (A)(0) = /if (A )( / Xiny^iwun) dn) (7) 

J N 

= T(ji\)( xi^Y 1 ^ ®rj(w M n))(t){wMn)dn). 



J N 

Let Vj-i G V a (g) X J ' -1 . We can always find G Ip ^ <g> Xj-i such that 
4>{wm) = Vj-i. Let {V}; be an approximate identity on N, i.e., {u l }i C 
C c °°(iV), u,(ti) dn = 1 for all I, and 

lim / (j){n)ui{n) dn = 0(e) for all G C c °°(iV). 

. Define 0' G C/p )(Ji/ by 

4> l {w M n) = u l (n)x{n)(f>{w M n) 

Then from (j^D and (j7j) 

lirn// A (/ x(™)~V(™Mn) dn) = limf(/i A )(/ xi^Y 1 ^){w M n) dn) 



// A (hm / u l (n)(j)(w Mn) dn) = f(// A )(lim / u l (n)<fi(wMn) dn) 

fJ>\{4>{w M )) = T(u x )(I ®n(wM))(p(w M )), 

where in the last step we are using that {u l }i is an approximate identity on 
N. We can rewrite the above equation as 

A*A(«i-i) = [(/ ® i7(^)*)f (a*a)](«,--i). (8) 

Since equation flSj) holds for all 6^8 -Xj-i it follows that u\ — (I ® 
n(w^)*)T(u\) G V^'cgjF- 7 " 1 as desired, which concludes the proof of the claim 

M 

Now let 

^^{AG^a^lAI^^O}. 

Observe that if A G W^ +1 , then A| r°° defines an element in Wh v (I'S' rT m = ). 
Our next goal is to define an isomorphism 

r 
3=0 
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such that the following diagram is commutative 




If we can find such an isomorphism, then $p iOV <g>% would be an isomor- 
phism for all j. In particular if (77, F) is a representation such that the action 
of M on F r is trivial, then a u <8> fj r = a v - r h' and hence 3>p,<t h , would be 
an isomorphism. By iterating this whole argument it is easy to see that this 
would imply that $p )0V is an isomorphism for all v. We will now proceed to 
the definition of the isomorphism $. 

Let G Ip ta „® v , and define 4>j '■ G — > V c ® X r _ 2 j by 

where pj : V a ® F — > V a <8> F r _ 2 j is the natural projection. Since pj 
commutes with the action of K M , <f>j\ K G lMr\K,a M nK®vj' ^ * s c ^ ear that 
0k = E5=o^k- Now S iven A e WM 7 ~<r„«*j)> define A i b y setting 
Aj(0) = \((f>j). Then A = £; =0 X j: and A, G for all j. Define 

0(A) = (A , . . . , A r ), with Xj = Aj| 7 ~ . 
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From this definitions it is clear that is an isomorphism, and besides if 
G U P ^ m , then 

r r 
j=0 j=0 

M / x{n>)~ 1( f>(wMn)dn) = YVaX / xW _ Vj(^Afn) tin). (10) 
Vat j=0 7 at 

Let « £ K 8 F, and let u,- = Pj(v). Lets assume that 4>{wm) = v and let 
{V}; be an approximate identity on N. Set 4> l (wMn) = u l (n)x(n)(j)(wMn) . 
Then from equation (fit)]) 



lim (ix( xfo) <t> ( w Mn 



)dn) = HmV/ij;]/ x(n) 1 d(w M n) dn) 



lim / u l (n)(f)(wMn) dn) = N //t (lim / u l (n)4>j(wMn) dn) 



3=0 
r 

^\{</){wm)) = ^2^j(M W m) 
3=0 
r 

i=o 

Which shows that the diagram ([9]) is commutative, which implies that $p i(7j/ _ r 
is an isomorphism. Iterating this argument we can show that ^p^,v is an 
isomorphism for all v G a' finishing the proof of (i). 
We will now prove (ii). Define 

111 '■ o! > {^Kr\M,a\ KnM )' 

by 7 M (z/)(0) = $p^. u {^){4>p,a,v)- We want to prove that 7^ is weakly holo- 
morphic, i.e., for all G ^nMdjrnM' ^ ne ma P ^ ^ ^m( z/ )( < ^) * s holomorphic. 
It follows immediately from lemma [TT1 that if Rz/ > then 7 M (z/)(0) = 
H° Jp au {4>) and hence 7^ is weakly holomorphic in this region. To show that 
7 M is weakly holomorphic everywhere, we will make use of the arguments 
given in the proof of (i) to implement a shift equation for 7^. 
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Let v G o' and G I^ nM a \ KnM ^ e arbitrary. By definition 

for some A G Wh x {Ip° u u _ r ). Let be a basis of F, and let {lj}JLi be its 

dual basis. Chasing the diagrams (J3J) and §§§ we can define rjj G ^^x(^fw)> 
j — 1, . . . ,m, and /i G Ip t a v ®n such that 

7/ >-r)(0) = A(0p, <TiI/ _ r ) = f , (^7/ i ®/ i )W 

= (£vi®mr T h). (12) 

Now since Y T h G ip^j, ®f we can find <pj G /£? nM CT | jfnM 5 j — 1> ■ ■ ■ > m i sucn 
that 

T T h = S ^{(t)j)p,a,u ® Vj. 

Hence 

(13) 

Then by flTJ) and (TT3]) 

This is the desired shift equation which shows that 7 M is weakly holomorphic 
everywhere. ■ 

6 Bessel models for admissible representations. 

In this section we derive an estimate on the dimension of the space Wh TX (V) 
for (it, V) an admissible finitely generated smooth Frechet representation of G 
as a corollary to Corollary 13. Let Vk deonote the underlying (g, K) module 

of K finite vectors in V. Let Vk be the admissible dual module of Vk and 
let W K be an irreducible (Lie(P), K M ) (K M = K(~)M) quotient of V K /nV K - 
Then Frobenius reciprocity implies that there is an injective homorphism of 
Vk into the i^-finite induced module from P to G of Wk- Let Wk denote 
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the K H M finite dual module to Wk- Then we have a homomorphism of 

the If -finite induced representation from P to G of 5p <8> W 7 ^ onto Vk- Let 

i 

(o~,H a ) denote the canonical completion of Sp ® W 7 ^ as a smooth Frechet 
module of moderate growth. Then the Casselman-Wallach theorem implies 
that there exists a continuous surjective G-homorphism, T, of Ip° a . onto V. 
Let T' be the adjoint of T mapping V into (ip^)' since T is surjective, T' is 
injective. With this notation in hand Corollary 13 implies 

Proposition 15 Let V be an irreducible, smooth. Frechet module of mod- 
erate growth for G. Let (j,F T ) be an irreducible represenation of K M , let x 
be a unitary character of N such that M x = K M then 

dimWh XtT {V) < dim Hom KM (W K , F T ) 

where Wk is the K M finite dual module of any irreducible (Lie(M), K M ) 
quotient ofYx/nVK- 

This result expresses an interesting relationship between Bessel models 
and conical models (i.e. imbeddings into principal series). 
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